Papers with multimodal synthesis tasks
Optimal Neural Program Synthesis from Multimodal Specifications (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for multimodal program synthesis combine noisy signals from the user with hard constraints on the program’s behavior. |
| Approach: | They propose an optimal neural synthesis approach where the goal is to find a program that satisfies user-provided constraints while also maximizing the program’s score with respect to a neural model. |
| Outcome: | The proposed approach outperforms prior state-of-the-art methods in terms of accuracy and efficiency and finds model-optimal programs more frequently. |